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Abstract 

The thermodynamic formalism allows one to access the chaotic properties of equi- 
librium and out-of-equilibrium systems, by deriving those from a dynamical parti- 
tion function. The definition that has been given for this partition function within 
the framework of discrete time Markov chains was not suitable for continuous 
time Markov dynamics. Here we propose another interpretation of the definition 
that allows us to apply the thermodynamic formalism to continuous time. 

We also generalize the formalism -a dynamical Gibbs ensemble construction- 
to a whole family of observables and their associated large deviation functions. 
This allows us to make the connection between the thermodynamic formalism 
and the observable involved in the much-studied fluctuation theorem. 

We illustrate our approach on various physical systems: random walks, ex- 
clusion processes, an Ising model and the contact process. In the latter cases, we 
identify a signature of the occurrence of dynamical phase transitions. We show 
that this signature can already be unraveled using the simplest dynamical ensem- 
ble one could define, based on the number of configuration changes a system has 
undergone over an asymptotically large time window. 
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1 Introduction 



1.1 Motivations and outline 

In trying to bridge the microscopies of a dynamical system to its macroscopic 
properties, amenable to a statistical physics treatment, the main road is the study 
of its chaotic properties. These revolve around such concepts as Lyapunov expo- 
nents, Kolmogorov-Sinai entropy, and perhaps more refined still, that of dynami- 
cal partition function. The latter was introduced by Ruelle (it is also called Ruelle 
pressure), and can be seen [1] as a dynamical analog to the well-known equilib- 
rium partition functions of statistical mechanics, except that it involves counting 
trajectories in phase space rather than microscopic states. This so-called pressure, 
in information theoretic language, is not but the Renyi entropy associated with the 
measure over the set of possible trajectories in configuration space [23]. It can 
then be connected to the dynamical entropies, like the Kolmogorov-Sinai entropy, 
also viewed as the Shannon entropy over the set of trajectories, or the topological 
entropy, which measures the growth rate of the number of allowed trajectories. 
Back in the seventies, the dynamical partition function also appeared as a conve- 
nient tool for characterizing, under prescribed mathematical conditions, NonEqui- 
librium Steady-State (NESS) measures, now called Sinai-Ruelle-Bowen (SRB) 
measures [2], by means of a variational principle. The general framework behind 
is that of temporal large deviations. A vast body of mathematical physics literature 
has been devoted to SRB measures and large deviations, with however relatively 
few direct spinoffs for theoretical physics, let alone experimental physics. Actu- 
ally, though these notions were mathematically well established in various frames 
(Hamiltonian dynamical systems, maps, Markov chains...), physically relevant ex- 
plicit results for the Kolmogorov-Sinai entropy are scarce, with a few exceptions 
for the Lorentz gas and hard-spheres [20, 25, 26]. There are also numerical stud- 
ies [27] of simple fluids attempting to relate the Kolmogorov-Sinai entropy to 
the equilibrium excess entropy, or to the self-diffusion constant. When it comes 
to determining the full topological pressure, existing results are confined to sim- 
ple maps [19] or to simple Markov processes in discrete time such as the Lattice 
Lorentz Gas [21]. However, recent years have witnessed the revival of large devi- 
ations, both at the experimental and theoretical level. On the theoretical side, they 
appeared as the natural language in which the fluctuation theorem of Gallavotti 
and Cohen [3] was expressed. The latter can be seen as a symmetry property of 
the large deviation function of the entropy current resulting from driving a sys- 
tem into a NESS. Variations around that fluctuation relation, such as the earlier 
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Evans-Searles [4], or the Jarzynski nonequilibrium work relation [5], also rely on 
the concept of large deviations. The experimental motivation lies in the belief that 
global -i.e. space averaged- quantities, rather than local probes, are a better way 
to approach and above all compare between themselves systems out of equilib- 
rium. However, since the peculiarities of a NESS also result from its microscopic 
dynamics, it was suggested to measure time averaged (over a large time interval) 
quantities, and to build up the corresponding distribution functions. More recent 
experiments on electric circuits have been used to probe the hypotheses underly- 
ing the mathematics of those relations (for a nonexhaustive list of experimental 
references, see [6]). 

While the above deals with actual dynamical systems, there also exist Markov 
dynamics counterparts to many of the results mentioned above, as far as fluctu- 
ation theorems are concerned (see [7] or [8] for the fluctuation relation, and see 
[9] for the nonequilibrium work relation). The motivations for addressing systems 
with Markov dynamics (with continuous time) are to be found both in the greater 
ease in performing numerical simulations (as cleverly proposed in [10]) and in the 
analytical insight that can be gained through exact [11, 12, 13, 14, 15] or approx- 
imate calculations [16]. To the best of our knowledge, these explicit calculations 
have been attempted only for systems with Markov dynamics. Given the successes 
of the Markov approach in understanding the various versions of the fluctuation 
and work theorems, it seemed natural to turn to the more general dynamical parti- 
tion function. As briefly sketched in [17], by contrast with the existing treatment 
of Markov chains [18, 19, 20, 21] there had hitherto been no satisfactory attempt 
to force the thermodynamic formalism of Ruelle into the framework of systems 
endowed with continuous-time Markov dynamics. As this was already noticed by 
Gaspard [22], passing from discrete to continuous time raises specific difficulties. 

Therefore, our primary purpose in the present paper is to introduce the dynam- 
ical partition function and the related topological (or Ruelle) pressure for systems 
with Markov dynamics. Note however that our motivation for determining this 
dynamical partition function is not rooted in our quest for the Markov analog of 
an SRB measure. For finite systems with Markov dynamics this is a dull endeavor 
since the stationary measure is known to be the unique solution to the stationary 
master equation [24]. Instead, we have in mind gaining physical insight into the 
topological pressure. It is often presented as a measure of dynamical complex- 
ity, an interpretation which will appear quite clearly in systems with ergodicity 
breaking transitions. Beyond, our general goal is to be able to relate its properties 
(convexity, singularities, etc) to those of the system at hand, the latter display- 
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ing nontrivial dynamics, and possibly featuring strong interactions. Ideally, we 
would like to build up a picture gallery [28] for physically acceptable topological 
pressures, but in practice we will have to be more modest and we will focus on a 
restricted number of systems that we shall soon describe. Further investigations 
aiming at pursuing this goal, most notably for systems with glassy dynamics and 
for systems with quenched disorder, will be mentioned in our conclusion. 

It will turn out that the dynamical partition function can be seen as the gen- 
erating function of a physical observable. This will allow us to cast our findings 
into the more general framework of temporal large deviations. In setting up our 
mathematical approach, we will see that the latter observable is connected to - 
but very different from- the one considered by Lebowitz and Spohn [8]. They 
both are members of a rather general family of observables of which we shall fur- 
ther single out yet another one that we now describe. Over a given trajectory in 
configuration space, the simplest quantity of all to consider is the number of con- 
figuration changes that the system undergoes over a given time interval. While 
this is a seemingly trivial observable to consider, we will illustrate on specific ex- 
amples that much of the difficulties that pave the way to the full determination of, 
say, the topological pressure, can already be read off the study of the statistics of 
this event-counting observable. More important, we find that "dynamical phase 
transitions", as defined for example in [23], can already be observed on this simple 
observable, and not only on the topological pressure. We propose a new tool to 
study how the structure of the trajectory space is affected by the dynamical phase 
transition. 

We now describe the various systems that we have chosen to illustrate our ap- 
proach. We begin with examining the simple lattice random walk case. We con- 
tinue with an interacting lattice gas, namely the one dimensional exclusion process 
with periodic boundary conditions, for which our analytic results are somewhat 
less extensive, but that has in the recent past [11, 12, 8, 29] served as a testbench 
for many of the ideas discussed in this introduction. In the case of the symmetric 
exclusion process we found that, though there is no first order dynamical phase 
transition, the event-counting observable mentioned above shows signs of a sec- 
ond order dynamical phase transition. Then we turn to two mean-field models 
of interacting degrees of freedom. The first one is the well-known equilibrium 
Ising model, with a second order symmetry breaking phase transition to an or- 
dered state at low temperatures. We have shown that the thermodynamic phase 
transition induces a first order dynamical phase transition, a signature of which 
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can already be found on the event-counting observable. Besides, we were able to 
give a picture of the structure of the trajectory space through the transition. The 
second one is the contact process, for which a supplementary difficulty arises, as 
in the thermodynamic limit two stationary states -an active and an absorbing one- 
exist. 

But before embarking into the study of these physical systems, we devote 
Sec. II to a reminder of the definitions of Lyapunov exponents, Kolmogorov-Sinai 
entropy, and also of the state of the art [18] concerning systems with discrete-time 
Markov dynamics. Sec. Ill contains our construction of the dynamical partition 
function for systems with continuous-time Markov dynamics, and connects to the 
existing literature. Sees. IV, V and VI are concerned with our physical examples. 
Conclusions and a number of future research directions are gathered in Sec. VII. 

2 Kolmogorov-Sinai entropy in the theory of dynam- 
ical systems 

2.1 Dynamical systems 

Let r(t) be the coordinate of a dynamical system evolving according to ^ = 
jF(r). Consider now two infinitesimally close initial points r(0) and r(0) + 5r(0) 
and follow the evolution of the difference 5T{t) between the two. This will evolve 
according to ^ = ^5T. The eigenvalues of the linearized evolution operator 
once averaged with respect to the stationary measure, make up the Lyapunov 
spectrum {A,} of the dynamical system. There are as many Lyapunov exponents 
as phase space dimensions. Each of them characterizes the dynamical instability 
of the system along an individual direction. A system with at least one positive 
Lyapunov exponent is termed chaotic. In order to characterize global, rather than 
individual, chaoticity, the Kolmogorov-Sinai entropy was defined. Given a parti- 
tion of phase space, within this coarse grained description, the dynamics becomes 
probabilistic, and this allows one to construct a measure over the set of physi- 
cally realizable trajectories of the system over some time interval [0, t] (which we 
also call histories). We define the Kolmogorov-Sinai (KS) entropy as the Shannon 
entropy corresponding to the measure over the set of histories: 

1 J2 histories Prob{history} hi Prob{history} 

hKs = - lim - ^2Sio^^ (1) 

t^oo t 2^ histories Probjhistory } 

from O^t 
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where the supremum is taken over all possible partitions and the average is taken 
over the initial configuration. The denominator is equal to 1 for a close system. 
From its definition, it is clear that /iks measures the dynamical randomness of the 
system at hand. It is also connected in a simple way to the Lyapunov spectrum, 
by means of Pesin's theorem, which states that 

hKs = -7 + 5^ (2) 

Ai>0 

where 7, defined for an open system, is its escape rate (and is otherwise zero). 
Note that the KS entropy is defined for a system in a stationary state, in or out of 
equilibrium. Even if one would like to relate h^s, at least in equilibrium situations, 
to the standard Boltzmann entropy, there is no direct connection between both, the 
latter being an intrinsically static object while the former is dynamical in essence. 
However, Boltzmann's entropy variations are related to /iks- Finally, we turn to a 
definition [1] of the dynamical partition function Z(s, t) 

Z{s,t)= J2 (Prob{history})^"' (3) 

histories 
from O^t 

In practice the so-called thermodynamic limit t very large is understood. We have 
also substituted 1 — s for the canonical notation P which we keep for denoting an 
inverse temperature (the reason for introducing s in this way will become obvious 
when we shall express Z as a generating function). There is an alternative for- 
mulation for the dynamical partition function, which involves the local stretching 
factors (see e.g. [30] for a physical example). The intensive potential ip+is) asso- 
ciated to this partition function is the topological pressure (or Ruelle pressure), 

4j+{s) = lim - In Z{s,t) (4) 

t^oo t 

which can also be interpreted [23], in information theoretic language, as the Renyi 
entropy over the set of histories. It is possible to recover /iks from the topological 
pressure, /iks = ^+(0) (or ^ks = ^+(0) — 7 for an open system, with 7 = 
— ^^+(0)), along with other quantities such as the topological entropy /itop, which 
measures the grows rate of the number of possible histories as time is increased, 
and is given by /itop = il)+{V). 

2.2 IMarkov chains 

Given the definitions above, there is a natural way, as explained by Gaspard [18, 
31], to extend the definitions of the dynamical partition function and of the KS 
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entropy to discrete time Markov processes. Consider a Markov process governed 
by the discrete-time master equation for the probability P{C, t) to be in state C 
after n steps: 

P(C, t + r) - P(C, t) = Y^ [w{C' C)P{C', t) - w{C ^ C')P{C, t)] (5) 

C'+C 

where r is the time step (and t = nr \% the elapsed time). We have denoted by 
w{C ^ C) the transition probability from configuration C to another configura- 
tion C. The probability of a history Cq ^ . . . ^ C„ taking place between and 
t = riT reads 

P(Co ^ . . . ^ C„) = P(Co, 0)t/7(Co ^ Ci) . . . «;(C„_i -> C„) (6) 

Note that successive configurations Ck, Ck+i can be equal in the previous relation. 
The corresponding probability of remaining in the same configuration C during a 
time step is 

w{C-^C) = l-Y^ w{C C) (7) 

C'^C 

By definition of the KS entropy we may directly write that 

/iKs = - lim — V P(Co ^...^Cn) lnP(Co ^ . . . ^ C„) (8) 

n— >oo TIT 

Co,..Cn 

It is easy to see [22] that the above expression reduces to 

h^s = -- VPst(C) w(C ^C')\nw(C ^C) 

T 

Cfi' 

= ^ ^'))st (9) 

where we have introduced the stationary measure Pst(C). Several explicit calcula- 
tions of this quantity can be found in Dorfman [19] or in Gaspard [18]. 

2.3 Taking the continuous-time limit 

We now wish to take the continuous-time limit of (9). We scale the transition 
probabilities between different configurations with the time step r: 

w(C -^C') = tW{C ^C) (10) 
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in such a way that the master equation (5) yields its continuous time analog when 
the limit r ^ is taken, namely 

dtP{c, t) = J2 [wi<^' c)P{c\ t)-w{c^ c')P{c, t)] (1 1) 

As done in [22, 32], the KS entropy defined in (9) can be expressed in terms of 
the transition rates W: 

hKs = -J2 W{C ^ C) In {rWiC C')) (12) 

C,C' 

It is now clear that the limit r ^ in (12) does not exist, since the latter exhibits 
a Inr divergence as r 0. Given that the transition rates W are dimensionful 
quantities, and given that apparently the only available time scale is r, we cannot 
expect to get rid of r without further thoughts. This means that even if we were 
tempted to retain in (12) only the finite contribution as r ^ as the meaningful 
KS entropy, we would need to find an appropriate time scale to render this piece 
well-defined (the argument of the logarithm must be dimensionless). 

The one-dimensional lattice random walk perhaps constitutes the simplest ex- 
ample of a Markov chain: let p (resp. q, r) denote the probability of hopping to 
the right (resp. to the left, not hopping), then we have that 

/iks = [p Inp + g In g + r In r] (13) 

r 

It appears clearly that in the continuous-time limit, p and q become infinitesimally 
small, which produces an indefinite /iks- Since we have in mind describing as 
closely as possible dynamical systems, which evolve in continuous time, the goal 
we set ourselves is to find a consistent approach, intrinsically viable for Markov 
systems in continuous time. 

3 Systems with continuous-time Markov dynamics 
3.1 Histories and dynamical partition function 

We now consider a system with Markov dynamics, with transition rate W{C — *• 
C) from configuration C to configuration C, in which the probability P(C, t) to 
be in state C evolves according to the following master equation, 

dtP = WP (14) 



8 



where the evolution operator has the matrix elements 



W(C, C) = W{C' C) - r(C)(5c,c' (15) 

and 

r(C) = Y^W{C^ C) (16) 

C'^C 

is the rate of escape from configuration C. In order to overcome the difficul- 
ties encountered in the previous section, an alternative is to consider histories 
Co . . . C/^ in configuration space, in the spirit of the study by van Beijeren, 
Dorfman and collaborators [30, 33] of the Lorentz gas and the Sinai billiard. To 
give (1) or (3) a consistent meaning for continuous time dynamics, we first inter- 
pret Prob [history] as the probability in the enumerable set of histories in config- 
uration space. A history in configuration space is a sequence Cq C^^- 
of successive configurations. An important difference between discrete and con- 
tinuous time dynamics is that in the latter, the system stays in each state C for a 
random time lapse drawn from an exponential distribution of parameter r{C) as 
defined in (16), which is interpreted as the rate of escape from configuration C to 
any other configuration. Then the system hops to its next state C with probability 



r(C) 

is the product of each jump probability 

K-l 

W [L 

r(C 



^^^j . Given the initial state Co, the probability of the history Cq ^ . . . ^ Ck 



Prob{history} = \{ ^^^"tf"^^^ (H) 



n=0 

where K is the number of changes in configuration space. 

We argue that in the same way as (1) and (3) are averaged over the initial 
configuration when dealing with deterministic dynamical systems, we similarly 
have to average over all possible stochastic time sequences t^, . . . ,1^ at which 
configuration changes occur (K is a fluctuating number). We know from general 
properties of Markovian system [24] that the duration At = — t„ between 
configurations C„ and C„+i is distributed according to the probability density 

7r(C„,At) = r(C„)e-^*^'(^") (18) 

Accordingly, if we take into account every possible history Cq — »■ ... ^ Ck 
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waiting probability: 

g-it-tK)r{CK) 

^1 h ... tK t 

I 1 1 1 1 

Co C\ C2 Ck Ck 



Figure 1 : One particular realization in time of a history Co ^ ... ^ Ck of 
successive configurations. Between tk and tk+i, the system stays in configuration 
Ck- 

between and t, the dynamical partition function writes 

Z(s,t|Co,to) = ^ ^ / (iti 7r(Co,tl - to) • • • / dtx Tc{CK~l,tK -tK-i) 

j^—nr^ r'^^'^to JtK — ^ 



K=0 Ci,...,C„ 



-{t-tK)r(CK) 



■ K 

n 

n=l 



W{Cn- 



Cn) 



r{C 



n-l 



(19) 



where the last exponential factor Q-(^-'tK)riCK) jj^g probability not to leave state 
Ck in the remaining interval between tK and t. We have assumed (Fig. 1) with- 
out loss of generality that the system starts from a fixed initial configuration Co 
(we restrict our study for simplicity to systems which can take a finite number of 
energy states). 



3.2 Kolmogorov-Sinai entropy 

In the same spirit as for the dynamical partition function, we interpret the defini- 
tion (1) for the Kolmogorov-Sinai entropy as 



h 



KS 



Inn T dti 7r(Co, h - to) . . . / dtK ti{Ck-i, tK - tK~ 

K=OCi,...,Ck -^tK-i 



-{t^tK)r{CK) 



[Probjhistory}] In [Probjhistory}] 



(20) 

where we assume that the definition does not depend on the initial configuration 
Co- For simplicity, we consider only close systems (except otherwise stated). Then 
we do recover the usual relation between /iks and Z{s,t), i.e. 

1 (91nZ(s,t) 



/iKS = lim 

t— >oo t 



ds 



(21) 



s=0 
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An a posteriori justification of (19) and (20) is that it yields a finite result, which 
does not depend on any external time scale nor on a particular choice of time units. 
In fact there is a natural -yet fluctuating- time-scale \/r{C) for each state C which 
is occupied. Furthermore, as detailed below (see Sec. 3.7), the KS entropy which 
results from (19) is intimately related to the entropy flow [8] of continuous time 
Markov processes, exactly in the same way as was noted by Gaspard for discrete 
time stochastic dynamics [22]. 

We should emphasize that the definitions that we put forward in our approach 
differ from those classically employed within the dynamical systems framework. 
The original Kolmogorov-Sinai entropy corresponding to the measure over histo- 
ries in time and in configuration space is infinite [18], as the information needed to 
describe the continuously distributed time intervals between configuration changes 
is itself infinite [34]. As such, this point of view cannot be used to compare dif- 
ferent Markov processes in continuous time. As explained above (Sec. 3.1), we 
instead preferred to focus on the information contained solely in the sequence of 
configurations, handling separately the averaging over time intervals. We exem- 
plify below in several examples that, in doing so, the original spirit and physical 
content of the Ruelle thermodynamic formalism is preserved. 

3.3 Expressions in terms of an observable 

It is possible to express both the dynamical partition function and the Kolmogorov- 
Sinai entropy in terms of a history dependent observable defined as 

V - W{Cn ^ Cn+l) 

Q+ = 2^^^ -7^^ (22) 

n=0 ^'^'""^ 

We see that in the configuration space, 

Prob{history} = (23) 
Hence, from (19), Z(s, t) can be identified as the generating function of Q+: 

Z{s,t) = {e-'^+) (24) 

where (■) stands for an average in both configuration and time sequences spaces. 
Further using the result (24) we also remark that 

hKs = - lim i (Q+) (25) 
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3.4 Topological pressure 



The moment generating function of the physical observable defined in (22) is 
precisely Z{s, t). The function ip+is) defined by 



'ip+i^s) = lim - \iaZ{s,t) 

t^oo t 



(26) 



is called the topological - or Ruelle - pressure in analogy with (4). This is also 
the generating function for the cumulants of Q^: 



t— >oo t 



' ds" 



(27) 



s=0 



The dynamical partition function is expected to grow exponentially with time as 
Qt^+{s)^ and the growth rate is the topological pressure. One immediately 

recognizes that the KS entropy can be obtained from ^+ through 



h 



KS 



ds 



(28) 



s=0 



In order not only to mathematically justify the existence of ip+{s), but also to 
relate it directly to the rates of the Markov process, we write an evolution equation 
for the probability P(C, t) that the system is in state C at time t with the value 

Q+- 



dtPiC,Q+,t) = J2 



W{C^C')P{C,Q+,t) 



(29) 



Noticing that the average over the configuration and time sequences is the 
same as Q+P{C, Q+, t), we have 



Cfi'^C ' 



(30) 



Taking the long time limit, we find that /iks can be expressed as the mean value in 
the stationary state 



h 



KS 



(31) 



St 
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of (the opposite of) an instantaneous observable 



MC) = J2W{C-. C) In ^'^ (32) 

Compared with the definition (9) for discrete time, the division by r allows to get 
rid of the time scale inside the logarithm. 

The master equation (29) also enables to have an insight on ^/'+ (s) . We can first 
point out that the Laplace transform of the joint probability distribution function 

P(C,Q+,t) 

P(C, s,t) = Y, e-^'3+P(C, Q+, t) (33) 
obeys the master-equation-like evolution equation 

W(C' ^Cf-'r(CyP {C',s,t) 



(34) 



dtP{C,s,t) = Y, 

C'+C 

-W{C ^C)P[C,s,t) 
which can be written as 

dtp = W+P (35) 
where the evolution operator has the following matrix elements 

W+(C,C') = W{C' ^ Cy-'r{Cr - r{C)6c,c'. (36) 

Then, as 

Zis, t)=Y, e-^'^+PlC, Q+, t) = J2 He, s, t) (37) 

C,Q+ C 

we conclude that the topological pressure is well defined by (26) and ap- 

pears as the largest eigenvalue of the operator W+. 

Likewise, in the context of deterministic dynamical system theory, the topo- 
logical pressure ^/'+ (s) appears as the maximum eigenvalue of the Perron-Frobenius 
operator [18, section 4.5]. The operator (36) is the stochastic counterpart to the 
Perron-Frobenius operator. 
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3.5 Ruelle Zeta function 



The Ruelle Zeta function z), as reviewed by Gaspard [18], is defined as the 
Laplace transform of the dynamical partition function Z(s, t) with respect to time 



Jo 

The Ruelle Zeta function is analytic in the complex variable z except on some 
poles. The topological pressure ip+is) is the pole which is the closest to 0, and 
there are systems for which -ip^ is easier to access using that property. From the 
explicit definition (19) of Z(s,t) we remark that the temporal integrals are just 
interwoven convolutions which factorize after Laplace transform to yield 

3.6 Topological pressure in special cases 
3.6.1 Constant rate of escape r 

From last section we remark that one situation is especially simple when deter- 
mining the topological pressure ip+is): if the jump rates W{C C) are uniform 
in configuration space (we shall assume for definiteness that W{C C) takes 
only two values, or W), the local rate of escape from the configurations visited 
by the system r{C) = r becomes independent of C and the topological pressure is 
Poissonian 



(40) 



This result can be seen by directly finding the largest eigenvalue of the Perron- 
Frobenius operator (36) or by the following line of reasoning. In the defini- 
tion (19) for the dynamical partition function Z(s,t), the probability of config- 
urational histories Prob[hist] = depends on the history Co ^ . . . ^ Ck only 
through the number K of configuration changes: e'^+ = (7-)^. Thus, e'^+ de- 
couples from the average over time sequences to, ■ ■ ■ ,tK- One can thus compute 
separately the probability of this time sequence which is a convolution of expo- 
nential laws of common parameter r, which all combine to yield a Poisson law: 

ft ft KfK 

/ rftire"'^ / rft;^re-"(*^-*^-i) e-^(*-*^) = e""* (41) 

Jto JtK-i K\ 
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Then Z{s,t) takes the simple form (independently of the initial configuration): 



number of probability v 
liistories of /sT jumps Prob [hist] ^ ^ " 

It could also have been possible to obtain this result by determining the Ruelle 
Zeta function (39) 

1 f nn^r- x" i i ^^^^ 

The computation was greatly simplified because all jumps of the history are 
identical and independent. 

3.6.2 Random walk with reflecting boundary conditions 

To see what happens when jumps are not identical, we can consider a particle 
jumping on a chain of three sites with reflecting boundary conditions. All jumps 
occur a the same rate 1 except for one, whose rate is w. The corresponding Markov 
matrix and the Perron-Frobenius operator read 

-1 {w + iy o\ 

w^-' -w-l 1 (44) 

{w + iy -1/ 

The topological pressure follows 

ijj+{s) = ^ ^^-2 - w + w'^^ ^/w'+^ + 4(1 + wy{w' + w)^ (45) 
and it does not correspond to (5+ being Poissonian. 

3.7 Large deviation formalism, time-reversed KS entropy, and 
entropy flow 

As explained in Gaspard [18, section 4.2], a variety of dynamical ensembles can 
be constructed following a similar procedure as the one we followed with the 
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variable Q^. In fact, any time integrated observable A{t) constructed with an 
arbitrary function a according to 

K-l 

A(t) = ^«(C„,C„+i) (46) 

n=0 

with K the number of configuration changes undergone by the process over the 
time interval [0, t], can be exploited in the same vein. Admittedly, a limited num- 
ber of choices will be physically relevant. 

Due to the specific form of A, a master equation can be written for P(C, A, t), 
and the Laplace transform Pa{C, s, t) = J2a ^ '^^PiC, A, t) will then evolve ac- 
cording to dfpA = ^aPa, where 

Wa{C, C) = W{C' C)e-""('^''^) - r{C)5cfi' (47) 

The largest eigenvalue V'a(s) of W^i, with eigenvector Pa{C, s), is the generat- 
ing function of the cumulants of A, iI>a{s) = limt^oo 7 ln(e~''^). This is a con- 
vex function of s. One can also access the first moment of A in the long time 
limit, limt_oo(^)/t = {Ja{C))su with the related current Ja{C) = Y.a ~^ 
C')a{C,C'), relying on the sole knowledge of the stationary state distribution. 
Besides, given that there exists a master equation governing the evolution of 
P{C, A, t), its positivity is conserved, which means that also -Pa(C, s,t) > at 
all times, and consequently 

lim e-^-^(^)*PA(C, s, t) = Pa{C, s) (48) 

t— >oo 

is also positive. This allows, after appropriate normalization, to interpret the 
eigenvector Pa as a probability distribution. Direct numerical access to tpAis) 
but also to Pa{C, s), as recently proposed in [10], can be achieved by constructing 
an auxiliary Markov process (based on W^) whose stationary distribution is pre- 
cisely the normalized Pa- Much physical insight can be gained from Pa, as we 
shall see throughout the study of the Ising model and the contact process. 

An interesting A variable that we will spend quite some time on is the one ob- 
tained by setting in (46) a = I: this is K{t), the number of configuration changes 
that have occurred over [0, t\. This is certainly the simplest one to consider, which 
does not make its properties any trivial at all (at first sight one would be tempted 
to see K as Poisson distributed, which is wrong in most cases). It will further 
be shown to be intimately connected to Q^. We postpone our discussion to the 
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treatment of our physical examples. 



Another prominent variable is the action functional introduced by Lebowitz 
and Spohn [8], endowed with the meaning of an integrated entropy flow, defined 

This is the observable whose cumulant generating function ^s(s) = limj^oo \ ln(e ^'^^) 
verifies the symmetry property ^5(5) = ~ which is one of the possible 
formulations of the well-known fluctuation theorem [35, 36, 3, 18, 7, 8, 37]. In 
boundary or field driven systems [8, 13, 38, 39, 40, 14], for instance, this entropy 
flow is simply proportional to the particle current flowing through the system, the 
proportionality constant being the force driving the system out of equilibrium (a 
chemical potential or a temperature gradient, an applied field, etc.). It is charac- 
terized by a nontrivial large deviation function only for nonequilibrium systems 
(more precisely those breaking detailed balance but for which W{C ^ C) ^ 
only if W{C' — > C) 7^ 0). In general, this entropy flow is a linear combination 
of the various currents (charge, particles, energy, momentum) forced by an ex- 
ternal drive, weighted with the conjugate forces (or affinities). The interpretation 
of Qs as an integrated entropy flow follows from the remark [8, 32, 37] that the 
time-dependent entropy S{t) = — -P(C, t) In P(C, t) evolves according to 

-77 = O-in- + CTf (50) 

at 

where a^^- is defined by 

-" = 51: - c')P(c, - w(c' ^ c)P(c', t)] i,> 

(51) 

and verifies > 0, with equality iff the system reaches equilibrium (with de- 
tailed balance P^{C')W{C' C) = P^q{C)W{C C')). The second term o-f 
is the entropy flow: it arises from the external forces that drive the system into a 
nonequilibrium steady-state, for which af = —a-u-r < and 

^f=-(J5(C)).t = -lim^ (52) 



where Js{C) = J^c W{C ^ C) In 
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It is of course desirable to make contact between entropy and the entropy 
variation rates Uin- or af and the dynamical entropies. In order to achieve that 
goal, we dwell into the presentation of Gaspard [22] (carried out for discrete time 
evolution) by introducing an additional observable describing time-reversed 
trajectories, 



Q_M = 5;;,„l!^(%L^ + ,„rI^ (53) 

r(C„+i) r(Co) 

The additional piece In appearing in (53) stands for aesthetic reasons: it is 
non-extensive in time ana could have been dropped without any physical conse- 
quence. There exists a corresponding cumulant generating function ^_(s) and 
related time-reverse KS entropy h^^: 



h 



R 
KS 



ds 



= - lim = -{J-{C))st (54) 



with J_(C) = Y.a^i^ CO In ^^^[^'^'' ■ By construction one immediately 
notices that 

(i) Qs = Q+ - , (ii) Js = J+- J- (55) 
and, in the steady state, 

(iii) (Tf = /iKs - /^Ks (56) 

Equality (iii) in (56) also appears in the dynamical system literature: /iks (resp. 
— /i^s) is the sum of the positive (resp. negative) Lyapunov exponents and there- 
fore (Tf is indeed the phase- space contraction rate (the sum of all Lyapunov ex- 
ponents). We have of course no such a microscopic interpretation within the 
Markovian framework. Note that equalities (i) and (ii) in (55) hold for fluctuating 
variables. 



3.8 Analyticity breaking of the large deviation functions 

In general, for small s, iI)a{s) comes as the eigenvalue of a perturbation of the 
(unique) stationary state. The uniqueness implies in particular that this function 
is analytic in the vicinity of 0. However, it can happen that for s larger than some 
threshold value Sc, it has to be obtained from the perturbation of a state which is 
not the stationary state anymore (we notice that since W^(s) is not a stochastic 
matrix anymore for s 7^ 0, the Perron-Frobenius theorem does not apply and the 
maximal eigenvalue of W^(s) can cross another eigenvalue while varying s). In 
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that case, we may have to examine the whole spectrum to determine V^a(s) for 

S > Sc. 

Then, ^/'a(s) need not be analytic on the whole real line. Such "dynamical 
phase transitions" have already abundantly been studied in the case of V^+(s) [23]. 
But such "dynamical phase transition" can also be observed for other observables. 
An example in the case of tpxis) is given in Sec. 6. 

In some cases the situation is even worse: it happens that systems present 
two stationary states in the thermodynamic limit, an absorbing state and a non- 
trivial one (when the number of degrees of freedom becomes infinite, the Perron- 
Frobenius theorem does not apply either). In that case, the change of perturbed 
state can occur precisely at s = 0, and ^a(s) may not be analytic at s = 0. An 
example of such a situation is studied in Sec. 7. 

3.9 State-dependent dynamical entropies hKs[P]-> ^Ksi^] 

The Kolmogorov-Sinai entropy is intended to represent the dynamical random- 
ness of a system when following its evolution in phase space. When a system 
evolves in time starting from an initial state P which is not the stationary solu- 
tion to the master equation, we expect the dynamical randomness to evolve in 
time, or in other words, to depend on the state of the system. Expression (31) 
strongly suggests to introduce the state-dependent dynamical entropies /iks[-P]> 
/i^s [P] through 



and similarly 

hUP] 

We study the example of an infinite range Ising spin system in Sec. 6.3 



= -(Y,W(C^cW^=f^)p (57) 
= -Y, P(C)W(C ^ C) In '^'^ ^'^ (58) 

C,C' ' 

= -Yl mWiC - C) In ^^^^^ (59) 

C,C' ' 
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4 Physical example 1: Random walks 



This simple example provides an interesting illustration of the difference between 
discrete and continuous time dynamics (Sec. 4.1). When the particle moves on 
a lattice with open boundaries, it also constitutes an example of a system with 
escape (Sec. 4.2). 

4.1 Single random walk on a lattice 
4.1.1 Discrete time random walk 

We consider a particle moving on an infinite d-dimensional square lattice. It hops 
with probability Dr from one site to its 2d neighbors at each time step of duration 
r of its evolution. The probability of not moving at each time step is 1 — 2dDT. 
The stationary state is uniform. The probability of a history of n = t/r steps 
with m particle jumps is equal to {Dt)™-{1 — 2(i-Dr)"^'". The dynamical partition 
function writes 

Z(s,nT) = (''V2rf)'" [(Dr)™(l -2rfDr)"-™]'"' (60) 
m=o 

= [2d{DTy-' + (1 - 2dDT)^-'Y (61) 
The topological pressure is 

i:+{s) = ^ In [2d{DTy-' + (1 - 2dDTy^'] (62) 
and the KS entropy 

hi^s = -2dD\nDT- -(1 - 2dDT)\n{l - 2dDT) (63) 

r 

When the time step r is adjusted so that the particle moves at each time step 
{2dDT = 1), we simply find 

ij+{s) = 2dDs In 2d and /iks = ^+ (0) = 2dD In 2d (64) 

When sending the time step r to zero, we have 

ip+is) = -2dD{l -s)+ 2dD^-'T-' + 0{t) (65) 

and 

/iKs = 2dD{l-\n Dt) + 0{t) (66) 
As seen in the general case, the limit r = is not well defined. 
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4.1.2 Continuous time random walk 

We consider the continuous time version of the random walk considered in the 
previous section: the particle now jumps with rate W{C C) = D to one of 
its neighboring sites. The topological pressure can be obtained directly from the 
expressions (40)-(42) for a constant rate of escape 

Z(s,t) = e*2'^^[(2d)»-i]. ^^(s) = 2dD {{2dy - 1) (67) 

and 

/iKs = (0) = 2dD In 2d (68) 

/itop = ^+(1) = 2dD {2d - 1) (69) 

We remark from (64) that even if the KS entropy is the same as in the discrete time 
random walk with time step r = l/(2dD), the two topological pressures differ. 
The fact that both KS entropies have the same expression is a simple consequence 
of the relations (9) and (31) and from the observation that in the continuous time 
RW, the rates of escape r(C) do not depend on the position of the particle. Then, 
the discrete and continuous time dynamics are simply related by choosing the 
discrete time step r to be equal to the inverse of the configuration-independent 
rate of escape r(C) = r. 

On the contrary, we can interpret relation (3 1) by saying that in the continuous 
time approach, the relevant time step r differs upon each jump and is equal to the 
inverse of the configuration-dependent rate of escape r(C). 

In any case, one should keep in mind that, though (66) and (68) give the same 
expressions, they were obtained for different definitions of /iks- 

It can also be noted that, if one defines a Lyapunov exponent for the random 
walk through an equivalent one-dimensional map, as described in [41, 19, 17], we 
recover Pesin's theorem (2). 

4.2 Random walk with open boundaries: an example of system 
with escape 

Consider now a d-dimensional lattice, infinite in d — 1 directions and finite of 
width £ in the remaining direction, embedded with absorbing boundaries. The 
Perron-Frobenius operator W+ splits in a direct sum of d one-dimensional opera- 
tors corresponding to the d independent directions of the lattice 

W+ = © Wf°^ © ... © WV~^ (70) 
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with 



W 



I -2D D{2dy 
D{2dy -2D D{2dy 



(0) \ 



V (0) 



D{2dY -2D D{2dY 

D{2dy -2D J 



(71) 



t elements 

and W^"* is the infinite version of W^''. The topological pressure is the 

maximum eigenvalue of W+. We find 



{2dy (^cos^-l^+d((2rf)^-l) 



= 2D 

from which we get the escape rate 

7 = -^+(0) = 2D 
expanding for large ^ to 



(72) 



7 = D 



(73) 



(74) 



Gaspard and Nicolis [42] have shown that such relation holds in the discrete time 
approach. Our continuous-time approach preserves the link (74) between trans- 
port properties and escape rate in open systems. 



4.3 Many particle random walk: different points of view for 

We now consider N independent random walkers on a lattice of L sites with peri- 
odic boundary conditions. Each one still hops with rate D, so that r(C) = 2dND. 
Then, with the same calculation as in Sec. 4.1.2, we find 

^+{s)= 2dND [{2dNy - 1] (75) 

The topological pressure, and the KS entropy /irs = ^+(0) = 2dND hi{2dN), 
are not extensive in anymore. It could have been tempting, as the particles are 
independent, to rather write ^Ar(s, t) = {Zi{s, t))^, and then the topological pres- 
sure 2(iZ}A^ [(2^)^ — 1] would have been extensive. The difference comes from the 
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fact that in the first case, the order in which particles jump has been considered as 
part of the configurational trajectory, and not in the last case. The first approach 
seems the correct one, as it can be generalized to interacting particles. Besides, 
as we shall see in the next section, the non-extensivity of /iks was already present 
in discrete time with sequential update and is thus not specific to the continuous 
time limit. 

5 Physical example 2: Exclusion processes 

We now consider interacting particles, more precisely, a simple exclusion pro- 
cess, i.e. a gas of N mutually excluding particles diffusing on a one-dimensional 
periodic lattice of L sites. We denote a generic configuration of the system by 
n = («!,..., ul), with rii = 1 when site i is occupied by a particle or nj = 
otherwise. 

5.1 Totally Asymmetric Simple Exclusion Process (TASEP) 

We first consider the Totally Asymmetric Simple Exclusion Process (TASEP) 
where particles can only jump to the site on their right. Though the full calcu- 
lation of the topological pressure is quite intricate, /iks is much simpler to obtain 
via its expressions (9) or (31). We calculate it now for various types of dynamics. 

5.1.1 TASEP: parallel updating 

At each time step r = 1, each particle may go forward with probability p if the 
site in front is empty. 

Let ric be the number of clusters in a configuration C. There are (J^j^) config- 
urations C which are obtained from C by moving k particles. The corresponding 
transition probability is w{C C) = p^{\ — p)("'^^^). Then 

h^as = -{nc)st [plnp + (1 -p) ln(l - p)] ~ -Lp(l-p) [plnp+ (1 ~ p) ln(l - p)] 

(76) 

for large systems. 

5.1.2 TASEP: random sequential updating 

At each time step r = one bond + 1) is chosen randomly. If Uiil — 
rij+i) = 1, the particle jumps forward with probability p. 



If a configuration C can be obtained from C by moving exactly 1 particle, 
the corresponding transition probability w{C C) = j. There are Uc such 
configurations C. The probability to stay in the same configuration is w{C — *• 
C) = 1 — Ucj^. To leading order in L we find 

hKs=Pp{l~ p)L\nL + 0{L) (77) 

Thus /iKs is non extensive though the dynamics is still discrete in time (and thus 
though /iKs is still defined using (9)). 



5.1.3 TASEP: continuous time dynamics 

For the continuous time dynamics, the transition rate between configuration n and 
n' =(..., 1 - nj, 1 - rii+i, . . .) is W{n n') = Dni{l - Ui+i). 

In order to find a finite value for h^s, we are now using the definition (31). We 
note that, at fixed number of particles N = J^i^i^ the stationary state is uniform 
and each configuration has probability Pst{n) = 1/ (^) . Besides, In 14^ is equal 
toWlnD. Thus the KS entropy can be written 

hKs = (r(n)ln^>^^ (78) 

where the instantaneous rate of escape r(n) = D 72,(1 — rii+i). As the steady 
state is perfectly random, we see [43] that all A; -point correlation functions Ck 
have simple expressions: 

Ci = {ni)st = j (79) 

C2 ^ {n,n2)st = ^^^I^^ (80) 

_ iv(iV-l)...(iV-M + l) 

Cm = \n\no - ■ -HMinf = — ; ^ ; ^ (81) 

\ 1 2 Mist L{L-l)---{L- M + 1) ^ ' 

In the thermodynamic limit ^ oo, L ^ oo with N jL = p, we get 

Dp{l — p). For finite systems, the mean value of the instantaneous rate of escape 

r(n) is, taking finite size corrections into account. 
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Then r(n) can be split into two parts, its mean value, of order L, and a fluctuating 
part defined as 

r(n) = (r(n)),t(l+e//L) from which we get ^ = ^ ^(^) " 

{r[n))st 
(83) 

By definition, to all orders in L, we have {Cist = 0. Moreover, 



{r{n f)st - {r{ n))^, 



Once the expression for {r{nf),t = 4:L - C2 + (L - 3) {C2 - 2C3 + C4) 
obtained, we get the exact expression 



is 



,.2. _ LiN-l)iL-N-l) 

N{L-N){L-2) ^ ^ 



which expands in powers of L as )st = 1 + 0{l/L). This allows us to expand 

D 



hKs = {r{n) In ^)^t through 



hKs = (r(n)),, ln(^)., + ^(r(n)),,i^ + 0{1/L) (86) 
Denoting a = Dp{l — p) and collecting all terms, we find 

/iKs = La In(La) + a hi{La) + -a + y In L + 0{l/L) (87) 

We could also have developed r around its thermodynamic limit {r{n))st/L 
Dp{l - p). Then {^st 7^ but {e)st = 1 + 0{l/L). 

For the TASEP model, the number of configuration changes K is equal to the 
total distance covered by all the particles within a certain time interval. The large 
deviation function associated to this quantity has already been calculated both for 
in the large system size limit and for finite systems in [1 1, 12]. 



5.2 Symmetric Exclusion Process (SEP) 

We now consider the Symmetric Exclusion Process (SEP) where each particle 
hops with equal probability per unit time D to its right or left - if the target sites 
are empty. 
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In this case we have calculated not only the KS entropy but also the large 
deviation function associated with the observable K(t). Though this is a sim- 
pler observable than the complexity of the calculations is already present. It 
gives a cruder physical picture of the level of activity undergone by the system's 
dynamics than 

5.2.1 The Kolmogorov- Sinai entropy 

The same expression (87) as for TASEP holds, but now with a = 2Dp{l — p). 
For the SEP, the compressibility and the strength of the equilibrium current fluc- 
tuations, as defined by Bodineau and Derrida [13], are closely intertwined^ [16]. 
Thus one may speculate whether for another equilibrium model of interacting par- 
ticles, and beyond, for a realistic interacting gas, /iks can be expressed solely in 
terms of the thermodynamic compressibility. This issue, which is reminiscent of 
earlier discussions [27] certainly deserves further investigation. 

5.2.2 Number of hops 

Let K{t) be the number of hops performed by the Markov process on [0, t] and 
let P{K, t) be the probability distribution function of K{t). We also introduce the 
moment generating function Pk{s, t) defined by 

P^(s,t) = (e-^^) (88) 

and the related cumulant generating function 

^,,,(.) = ,ta (89) 

which turns out to be the largest eigenvalue of the operator Wk{s) defined by (see 
(47)). 

Wk(s; C, C) = e-W(C' ^ C) - r{C)5c,c' (90) 

There are a number of ways to obtain ipxis) in the regimes of interest s — » 0^ 
and s — > ±oo. The results are summarized here, while technical details will be 
published elsewhere. All these results are valid in the limit of large systems. 

'The coefficients D{p) and cr{p) appearing in [13] verify a{p)/D{p) = 2p^k^Tx{p), where 
X is the thermodynamic isothermal compressibility and T is the equilibrium temperature. For the 
SEP one has D{p) = D and a{p) = 2Dp(l - p). 
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• In the limit s — > — oo 

lim ^k{s)/{DL) = 2e-^ - 2p(l - p) - 2^^^^ + O(e^) (91) 

This result relies on a mapping to weakly interacting fermions, by means of a 
Jordan-Wigner transformation. 

• In the limit s ^ 0^, 

97/2 

lim ^IJKis)/iDL) = -2p(l - p)s + ^[p(l - p)fW + Ois') (92) 

The method that was used in this case - relying on a Bethe ansatz - could not be 
applied to the s 0"'' case. 

It is not so surprising to find a non-analytic behavior for tpx, as the symmet- 
ric exclusion process has already revealed non-analytic behavior for the particle 
current distribution function [8, 44]. 

As the first derivative of iI)k{s) is still continuous in s = 0, one could speak 
of a dynamical phase transition of order higher than one. 

• In the limit s ^ +00 

\im ^k{z)/D = -2 + + 0{z'^) (93) 

L— >oo 

This 2; ^ behavior is quite distinct from that found by Derrida and Lebowitz [11] 
studying the TASEP, who found ^k{z) = -I + (for < L/2). This is due 
to the strong irreversibility of the TASEP that prohibits backward jumps to take 
place (if < L/2, jumps, instead of 2 for the SEP, are necessary to return to a 
single cluster configuration). 



6 Physical example 3: Infinite range Ising model 

We now turn to our next example, namely a system of Ising spins (A^ ^ 1) 
(Tj = ±1 interacting with infinite range forces and equilibrated at the inverse 
temperature [3. The Hamiltonian of this infinite range Ising model reads 

1 JUp 

UicT = {ai}) = V aia. = (94) 

where M = ^jCj is the magnetization. The equilibrium probability -Peq(c) of 
a spin configuration cr = {a^} is given by the Boltzmann-Gibbs factor P(cr) ex; 
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exp[— /?7i(cr)]. In order to describe its time dependent and chaotic properties we 
endow the system with a continuous time Glauber-like dynamics in which each 
spin cTj flips with a rate 

W{ai -ai) = e"^"^^ (95) 

This is precisely the evolution rule considered by Ruijgrok and Tjon [45] who first 
studied the dynamics of this system. The rate of escape from a configuration with 
magnetization M depends only on M and is equal to 

r(M) = N cosh ^ - M sinh ^ (96) 

The master equation can be cast in the form of an evolution equation for the 
state vector |^) = Xlo- -Pl'^' 



d|^) 
"dT 



I VI/) (97) 



where 



W = 5^ - 1] e-^"^^^"^ (98) 
j 

= (M^ - AT) cosh + (M" + iM^) sinh (99) 

Here, the evolution operator W is expressed in terms of spin operators M°, 
a = x,y,z iY.a^"''^ = + 2)). with M° = Y^j^^j (tensor products are 

implied for the Pauli matrices a" acting on site j). Note that this expression is 
obtained under the assumption that the probability P(cr, t) depends only on the 
magnetization, which is the case in particular for the stationary state. 

An alternative way to describe the system would be to follow another Markov 
variable than the full configuration cr, such as the global magnetization M. That 
M is a Markov variable is of course an artifact of our mean-field model. One 
is now interested in the evolution equation for the magnetization state vector 
|^(A/)^ = ^j^^P(M,t)|M). It should be noted that (99) gives the evolution 
operator for the state vector |\1>(^^)) (with the Af° taken as operators acting on 
magnetization states), only if the states |M) are defined by 



\M} = E ( 



N ^ ' 

N+AI 



6 



cr,; 



\(t). (100) 
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For the somewhat more intuitive definition 



(101) 



the evolution operator would rather be 

- iMy N + M' 
W = — 



1^ IV 



N -M^ + 2 



2 N + M' + 2 ^ ' 



(102) 



as the escape rate from a given state |M) is still r(M). In the following, we 
shall always refer to the description by the full spin-state |^), except when stated 
otherwise. 

We now turn to the topological pressure. 



6.1 Topological pressure - paramagnetic state 

The topological pressure is the largest eigenvalue of the operator W_|_ whose ex- 
pression reads 

W+ = M" cosh ~ ^^^' r(M")" + zM^sinh ~^^^\ {M'y - r{M'). 

(103) 

In the high temperature phase, it suffices to resort to the same Holstein-Primakoff 
representation of the spin operator as that used in [45], 

= iV - 2a^a, = -i^{a) - a), = ^{a) + a) (104) 

in order to write W+ as a free boson operator whose ground-state energy yields 
the following topological pressure 



Ms) = N{N' - 1) + Ar^(l - (1 - -iV^/ V^'(l + S/3(2 - P)) - I3{2 - /?) 

(105) 

It is also possible to compute the large deviation function associated with the 
observable 

'i^' W(M„ ^ Af„+i) 
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and we find 

ipMis) = lim -ln(e~"^^0 

t— >oo t 

= {2' -1)N + 2%1- s){l- p) (107) 

- 2^/V2^(l-s(l-/3)')-/9(2-/?) 

We remark that in (105) (resp. (107)), to leading order, the distribution of 
(resp. Qm) is a Poisson law of parameter InA^ (resp. In 2), which reflects the 
completely randomized nature of the paramagnetic state. These results are valid 
in the high temperature /3 < 1 phase. We now address the ordered state. 

6.2 Topological pressure - ferromagnetic state 

It appears that below the critical temperature, the topological pressure shows much 
more complex features. The most notable of them is that the observable ceases 
to be Poisson distributed even to leading order in the system size. This is at vari- 
ance with what has been observed for the paramagnetic state. In order to gain 
some insight into the difference between the high and low temperature behaviors, 
we decompose the fluctuating magnetization M(t) into 

Mit) = Nm + ^{t)VN (108) 

This defines the noise strength ^(t), which we expect to remain of order unity. 
The fluctuating escape rate from a configuration with magnetization M given by 
(96) is, for N large, given by 

r(M) = nVi^ - e J^ ViV + lef3 (f3 - + 0{1/Vn) 

Vl-m2 2 V l-m^J 

(109) 

where the mean-field equation of state tanh(/9m) = m was used. From (109) we 
see that r(Af) shows only 0{1) fluctuations at /? < 1 (m = 0), rather than the 
generically expected 0{^/N) fluctuations. Fluctuations in the high temperature 
regime are thus much lower than in the ordered state. This will lead to more 
tedious mathematics in the ordered phase. 

Before tackling these, an interesting way to pinpoint the different nature of the 
high and low temperature phases is to inspect first a simpler quantity, namely the 
number K(t) of magnetization changes that have occurred over a time interval 
[0,t]. It should be noticed that the value of K is the same, whether we describe 
the system by its full configuration a or only by its global magnetization M. 
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As explained in Sec. 3.7, the large deviation function for K, iPk{s) = limj^oo j ln(e 
is the largest eigenvalue of Wi^, which has matrix elements 

Wk{M T 2, M) = z!:L±^e^P^'^/^ _ r{M)SM,MT2, ^ = e"^ (HO) 
We find, again using (104), above the critical temperature, that 

,Ijk{z) = {z- 1)N + z{l -(3)- ^z{z-(3{2-(3)) (111) 



Note that at the critical point, TpKi.z) = N{z — 1) — \/ z{z — 1). The singularity 
has moved from s = — ln/5(2 — /5) to s = (z = e^"*). Below the critical 
temperature, expressing Wa' in terms of a and as defined in (104) does not 
yield a free boson operator. We first quote our results and then sketch the route 
that has led to them. Retaining the leading terms in A^, we find that tjjx has the 
following implicit expression: 



zy 1 — mj^ — cosh PrriK + mx sinh Prnx 



(112) 



where 



^Kiz) =y^^ [3 - 6(1 - ml)P + 4(1 - mlfp^] 
1 — rrij^ 



+I3z^ 1 - m|- [(2 - [3) cosh l3mK + l3mK sinh /Jm^] [l - 2(1 - m\)l3] 

(113) 

and rriKiP, z) is the solution of 

mKl3 cosh l3mK + (1 — /9) sinh /Sm^- = ^ = z (1 14) 

such that i>K{z) is the largest. When z = 1, equation (1 14) is of course solved by 
the solution rn~^{(3) of the mean-field equation 

= ia.nh{pmf) (115) 
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From that remark, it is possible to expand around s = in powers of s by 
ion! 

co(/5) = coshm^'*(/3), we find 



searching solutions of (114) in the form rriK = rrSx + '^'k' s + . . .. Defining 



Nt Co N 2co{c^-l3y 

1 1 - 1 

Nt Co (cq-p) 



^ (ir^), = l + Co /J 1^ +0{1/N) (117) 

Co 

^ (ir^), = - + 3co-#^ [eg - (1 + /3)c^ - P{1 - 3P)cl - P'] + 0{l/N) 



(118) 

An interesting spinoff of this s — > expansion is that it shows that in the low 
temperature phase (cq > 1), the number of steps K is not distributed according to 
a Poisson distribution, even to leading order N (if it were so, only the I/cq term 
in the right hand sides of (1 16,1 17,1 18) would be present in the above cumulants). 

The way the parameter rriKiP, s) came out from the formalism is the follow- 
ing. In the high temperature phase, the Holstein-Primakoff representation (104) 
- with no rotation - allows directly to write W+ as a free boson operator. In the 
low temperature phase, it is necessary to rotate the spin operators M^, M^, 
by an angle 9 around the y axis, in order that becomes a free boson operator, 
with sin 9 = (/?, s) (after a suitable additional 6'-dependent rotation around the 
z axis). 

It is intriguing that by expressing the escape rate r(M = Nuik) = N{cosh{PmK] 
rriK sinh l3)mK as a function of p through rriKip) = a/1 — p^, one can see, by ex- 
ploiting (114), that to leading order j^iljxiz) = maXpjzp — j^r{p)} (a property 
holding in the (3 <1 phase as well). 

The physical meaning of this rriKiP, ^) interesting in itself: in order to arrive 
at an expression for the evolution operator involving free bosons, one must be de- 
scribing its low lying excitations, which requires knowing its ground- state eigen- 
function (the state Pk{M, s) appearing in (48) that has the eigenvalue il^xis)). In 
the high temperature phase, the average magnetization restricted to histories with 
a prescribed value of K is zero, because forcing a given value of K does not force 
the system into the broken phase. However, in the broken phase, the nonzero 
magnetization is itself a weighted average of average magnetizations correspond- 
ing to various values of K, and there is no reason for each value of K to contribute 
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equally to m}^' Instead we have that 

mK{s,f3) = lim ^y^MPK{M,s)^mP{f3). (119) 

M 

After all, it is reasonable that histories with K far from its typical value are char- 
acterized by different magnetizations. In other words, the ground state is highly 
nontrivial, as opposed to the high-temperature phase. In order to further illustrate 
our point, we have plotted s i— > rriKis, (3 = 1.4) in Fig. (2). There it can be seen 
that mK{s,P) jumps from a nonzero value at s > to zero at s < 0. On the 
one hand, at s > one is probing the regime in which K/t is typically smaller 
than its average value {r{M)), which we expect to be more frozen than typical 
configurations, that is, more ordered: this accounts for mxis, (3) growing with s. 
On the other hand, at s < 0, one is selecting histories that have a typical K/t 
larger than average, so that the corresponding states should be less ordered. There 
is in fact a dynamical first order phase transition as s varies from 0+ to 0^, where 
niK^P, s) jumps from a nonzero value to 0, which corresponds to a paramagnetic 
state. The jump discontinuity of ttik^P, s) yields a discontinuity in the deriva- 



rriKis, (3) 




— . — . — . — , — . — . — . — , — . — . — ^ s 

-0.2 0.2 0.4 

Figure 2: Plot of the rotation parameter m/^(s, P) as a function of s at = 1.4. 
The jump discontinuity at s = 0, in finite size A^, is smoothened into a continuous 
but steep drop centered around a critical value Sc = 0{N^^) < 0. 

five of ipK (which itself, being convex, must be continuous) as shown in Fig. (3), 
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which reads 




Figure 3: Plot of z ^ liisiN-^ooi'K{z)/N at P — 1.4, with z — e ^. The first 
derivative is discontinuous at 2; = 1. 

Returning now to the topological pressure, we parallel the reasoning carried 
out previously for K in terms of Q+: we write the corresponding operator W+ 
and perform a rotation of the magnetization operators (the angle 9 involved 
is such that sin 9 = m^(P, s)) in order that it can be expressed in terms of free 
bosons, and we find that below the critical temperature 

iP+{s) = iVV^(^) (s) + (s) (121) 

where the order and order N'^ coefficients are given by 

V'r(«)=p^-v-| (122) 

(«) ^q^l- s) (1 - p'p) - y^Ao+^^y Ai+Q'^A, 

(123) 
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where we used the notation 



g = 2 ( cosh /3m+ — m+ sinh Pm+) 
g = 2 ( sinh /3m+ — m+ cosh 

^0 = — [/3ttT'+ cosh /3m+ + (1 — /9) sinh /5m+] ^ 
Ai = —p(3 [(2 — /?) cosh /?m+ + m+/5 sinh /3m+] 



(124) 



(125) 
(126) 
(127) 
(128) 




(129) 



and the rotation parameter m+(s, /3) is the solution of 



p^^^ [Pm+ cosh /9m+ + (1 — /3) sinh /9m+] = g"* ^ [m+g + sq{l — 



such that ip+{s) is the largest. Again the quantity m+(s, /5) has the meaning of an 
average magnetization biased, for s ^ 0, over histories that are more (resp. less) 
random than the typical history for s > (resp. s < 0). For that reason we expect 
m+(s, P) to be a decreasing function of s, as is confirmed by plotting m^(s, (3) 
obtained from (130) as a function of s for /? > 1, see Fig. (4). Trajectories split 
into two classes, ordered and disordered ones. This splitting is not present in the 
unbroken phase {(3 < 1), for which m+(/3 < 1, s) = Vs. 

6.3 Kolmogorov Sinai entropy and chaoticity 

Here we focus on the KS entropy related to the process M{t) - and defined as 
before from the Qm observable -, which is luckily extensive. In the stationary 
state, /iks (in magnetization space) depends on /3 through c = cosh [/?m(/?)] 
where m(P) is the solution of the mean field equation 



To follow how /iks depends on (3 in the high temperature phase (/? < 1) one has 
to expand up to order 0. We find 



(130) 




(131) 



l + (ln2-l)/3(2-/j) 
2(1-/?) 



(132) 
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m+(s,/3) 




0.8 



0.6 



0.4 



0.2 



Figure 4: Plot of s i— > m+(s, /3) at /3 = 1.4 in the limit of large systems. 




Figure 5: Kolmogorov-Sinai entropy /iks in the stationary state, as a function of 
/3. In the ordered phase (/? > 1), the variations of h^s are of order A^, while in the 
disordered phase, they are of order 1 (inset). 
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Results are shown in Fig. (5). In a state P of average magnetization m, h^s[P] 
only depends, to leading order in A^, on m. 



-/iKs[P]=e^™^^ln 

^ KM J 2 



In a similar way 



1 + 



1 + m 

( 

1 — m 



+ e 



-/3m 



1 + m 



In 



1 + 



}_ ^ 2/3m 

1 + m 
(133) 



l/,f,[P]=e'3™^^ln 

^ KSL J 2 



1 + 



1 — m 

( 

1 + m 



2/3 m 



^ _L 1 +^ ^-2/3m 



1 — m 



(134) 



0.6 



0.4 - 



0.2 



/iKS and chaoticity 
are decreasing 




/?KS and chaoticity 
are increasing 



Figure 6: Kolmogorov-Sinai entropy /iks[-P] in a state P of mean magnetization 
m at fixed /3 = 1.2. 



6.4 On the extensivity of the KS entropy 

Though the /iks associated with the observable Qm and calculated in the previous 
section was luckily extensive, in general the /iks defined by (20) is not extensive 
in the number of degrees of freedom. Indeed, the dominant order for /iks = (0) 
obtained from (105) reads h^s ~ In A^. By contrast, in a dynamical system, the 
Lyapunov spectrum, and the KS entropy, are extensive in the number of degrees 
of freedom. The nonextensivity of the h^s calculated in this paper was already 
briefly commented upon in Sec. 4.3. As this was pointed out in Sec. 5. 1 .2, it is not 
specific to continuous time. Still, we wish here to suggest some possible cures. In 
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-1 -0.5 0.5 1 



Figure 7: Direct and time-reversed Kolmogorov-Sinai entropies in a state of mean 
magnetization m, in the disordered phase (/3 — 0.8). Notice that, as expected, 
^Ks < ^Ks- These two dynamical entropies are equal only at equilibrium magne- 
tization men — 0. 
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Figure 8: Direct and time-reversed Kolmogorov-Sinai entropies in a state of mean 
magnetization m, in the disordered phase (/3 = 2). Notice that, as expected, 
^KS < ^Ks- These two dynamical entropies are equal only at equilibrium magne- 
tization men ^ ±0.956 or at m = 0, which is unstable. 
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order to obtain an extensive topological pressure, we may scale the probability of 
a step from C ^ C with the number of available degrees of freedom. In the case 
of our Ising system, we introduce the observable 




K-l 

E 

n=0 



riCn) 



(135) 



Note that the associated large deviation function iPh{s) = lim^^oo 7 ln(e~"'*^), in 
spite of remaining convex, will a priori no longer be a monotonously increasing 
function of s, which is a defining property of a Renyi entropy. Skipping technical 
details, we have found that in the high temperature phase 



Ms) = l-P{l-s)- y/(l-s){l-py + s, iJnis) ^= s-^s (136) 



which has a trivial thermodynamic limit ipn/N as N ^ 00. On the other 
hand, for /5 > 1, we obtain 



and with m solution to 

m{r{Nm)/Ny — mpfi cosh (3m — p(l — (3) sinh I3m = (138) 

Combining these results into a single plot. Fig. (9), shows that some features 
present in ^+ (such as V^+(s > 0) = 0) are unaffected in -ipnis)'- both are 
monotonous (only to leading order in for tJjH{s)), and non-analytic in s = 0. We 
do not have further argument in favor of using -ipn/N as a bona fide topological 
pressure but that it is simple and that it seems to be sharing similar properties as 
the original at least for the model at hand (yet it can be shown that iI>'h{^) < 0, 
i.e. opposite sign to /iks)- 

6.5 One dimensional Ising model 

We consider an Ising chain of N spins in contact with a thermal bath at inverse 
temperature [3. The energy writes 



N 



{r{Nm)/N) - p{r{Nm)/N)\ p= Vl - ra^ 



(137) 




(139) 
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N 



Figure 9: Plot of s ^ liniAr^oo ipnis) /iV at /? = 1.4. 



We endow the system with periodic boundary conditions and Glauber dynamics 
with spin flip rate 

= 1 - ^ 7 (7i((7i_i + (7i+i) where 7 = tanh 2/3 (140) 
The Kolmogorov-Sinai entropy is 



In the limit N ^ 00 

hj^s = ^^^ + N\2/3-fte,nh^p -(1+7^) lncosh2/3l +2 sinh^ /3 + 0(ln A^/A^) 
cosh 2p '- 

(142) 

which is computed using that the correlations read {uiGi^r) — tanh'' /5. It is, as 
expected, an increasing function of temperature. 
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7 Physical example 4: Contact Process 



7.1 Motivations 

We now turn our attention to the infinite-range contact process: each vertex i of 
a fully connected graph of vertices is either empty (ui = 0) or occupied by a 
particle {rii = 1). The system is endowed with a Markov dynamics with rates 



where n = J2i the total number of occupied sites. This model has recently 
resurfaced in the literature: Dickman and Vidigal [46] studied in detail one of 
its defining properties, namely that it exhibits a nonequilibrium phase transition 
from an active to an absorbing state as the branching rate A is decreased below 
a critical value Ac = 1, with, in finite size, a single stable state, the absorbing 
one. Therefore, the stationary state distribution in the active state is only quasi- 
stationary. The lifetime of the active state, in finite size, was studied by Deroulers 
and Monasson [47], who also designed a systematic way to implement finite con- 
nectivity effects. Broadly speaking, the contact process phase transition belongs to 
the directed percolation universality class, and as such, is the paradigmatic model 
of nonequilibrium phase transitions. Our motivation for looking at the contact 
process with our own tools is precisely the existence of a phase transition, un- 
like any equilibrium one, that is encountered in many guises in the literature (see 
Hinrichsen for a review [48]). Interestingly, absorbing state transitions are now 
invoked within the framework of the glass transition [49, 50, 51]. At the moment 
we do not wish to address refined critical properties, and we shall be content with 
a mean-field version that will enable us to get the global picture of how phase 
space trajectories are affected by the presence, in the stationary state phase dia- 
gram, of an absorbing state transition. 

Much like the global magnetization in the infinite-range Ising model, the total 
number of particles n{t) = ^ . = 0, . . . , iV is also a Markov process, with the 
following rates 



As a reminder, we first sketch the main properties of the stationary state. For finite 
N, there is a single stationary state: this is the absorbing state where all sites are 



W{n, = 1 ^ rii = 0) = 1 
W{ni = 0^n, = l) = Xn/N 



(143) 



W{n n — 1) = n 

W{n = {N - n)\n/N 



(144) 
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empty. The time evolution of the mean number of particles reads 



^^"^-/(iV--)^--) (145) 



dt y 'N 

Given the infinite range of the interactions, the mean field hypothesis will be valid 
in the thermodynamic limit {n and N going to infinity, n/N p). In the station- 
ary state (145) simplifies into 

p[A(l-p)-l] =0 (146) 

We conclude that there exist two regimes according to the value of A. For A < 1, 
the stationary state is the absorbing state, with all sites devoid of particles, and 
when A > 1, the system reaches almost certainly a quasi- stationary state with 
mean density 

p=l-i (147) 

else it is trapped in the empty state. From here on, we shall assume A > 1 and use 
p as the only control parameter of the model. In order to circumvent the absorbing 
state in finite size, it is convenient to add to the original model an additional local 
injection process with rate h, 

= 1 ^ rii = O) = 1 

[ (148) 

= 0-*ni = l) = h + Xn/N 




or 




n 



(149) 

{N -n)[h + \n/N] 

The stationary state becomes unique for ^ oo, and the steady-state density p 
is given by 

\p + h = p/{l - p) (150) 

For > 0, explicit results will be expressed in terms of p and A. We now want 
to determine the large deviation functions of K{t), the number of configuration 
changes that have occurred over a time interval [0, t], and of Q+{t), which gives 
access to the topological pressure. 
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7.2 Special point A 



2p-l 



Our first paragraph deals with a special point in parameter space that, to the best 
of our knowledge, has never been commented upon in the existing literature, but 
whose mathematical structure is extremely simple. We decompose the total num- 
ber of particles into an average and a fluctuating part, 



n = Np + i\fN 



(151) 



and we express the fluctuating rate of escape from a configuration with n particles, 
in the stationary state. In the absence of particle injection {h = 0), and replacing 
A by its expression (147) in terms of the stationary state density p, we arrive at 



r(n) = 2pN + ^ 



2 -3p 
1-P 



p 



(152) 



hence the special point p = 2/3 (or equivalently A = 3) at which this escape rate 
has relative fluctuations of order 0{N^^) that are much weaker than the generi- 
cally expected 0{N^^/'^). A similar phenomenon occurs for h > 0, using (150), 



r{n) = 2pN + ^(1 - p)(A - A)VA^ - A^ 



(153) 



where 



A 



2p 



(154) 



There the special point with low fluctuations is at A = A. Under this constraint 
A = A, the interval covered by the stationary state density when the value of h is 
varied is ^ < p < |. The A = A behavior of r(n) bears much resemblance with 
that already noted for the high-temperature phase of Ising model in (109), with 
the formal correspondence P < 1 \ = A and /9>1^A7^A. As will now be 
seen, huge calculational simplifications occur at A = A. 



The generating function for the cumulants of K(t), the number of configura- 
tion changes that have occurred over a time interval [0, t] is the largest eigenvalue 
of the following operator 



'K 



(z) = -n+{N-n) 



An 

h /i 



1 

+ 2^ 



Xh 

h 

N 



(155) 
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where n = {N + M^)/2 is the particle number operator and z = e^''. Given that 
the detailed properties are being studied for the first time here, we shall provide 
the reader with a few more technical details than in the previous section on the 
Ising model. 

The spectrum of Wk can be found perturbatively in using the Holstein- 
Primakoff representation of the magnetization operators M". In general this con- 
sists in rewriting the A<f"'s as a carefully chosen rotation of another set of spin 
operators for which we will use the following exact representation in terms of 
creation and annihilation operators 

L"" = N - 2a)a (156) 
iU = a) [N -a^aY -{N -a}aY a (157) 
U = a) [N -a^aY + {N -a^aY a (158) 



The aforementioned rotation has to be chosen such that in the ground state, a) a 
remains small, so that an expansion can be performed. In the present case (A = A), 
we shall assume that it is already the case without any rotation, and we shall 
use directly M° = L". We expand Wa' in powers of A^ anticipating that in 
the ground state a)a will remain of as A^ — oo. And because, up to a 
constant contribution, W/c is quadratic in terms of a and a) (with A^-independent 
coefficients), this is indeed the case and we find that the largest eigenvalue iI)k{s) 
of Wx has the following expression 

{Root of a third degree polynomial if z < Zc 
z^l^ , 
2p(2-l)Ar-;z + - Vp(l-2p) + z(l-3p(l-p)) if z>z, 
1-p 

(159) 

provided the parameters verify A = "^^-pY ' ^'^^^ ^'^^ = 0, that is at A = 3, 
Zc = 1 and -^xiz < 1) = 0, while iPk{z) = ^{z - 1)N - z + z{;iz - 2) if 
z > \. Interestingly, to leading order in A^, the distribution of K is a Poissonian, 
as was precisely the case for the Ising model in the high-temperature phase (111). 
For /i 7^ 0, we find that for z ^ (that is for s oo) 

which describes reduced-activity histories with values of K much smaller than 
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{K). 



In much a similar way, restricting our analysis to the Markov process n(t) = 
J2i the topological pressure V^+(s) is the largest eigenvalue of the following 
operator 



-W+(s) =h + {N -h) 



An 



l-s 



-\{M- + iMy) (h + ^ 



^{M''-iMy) (n + h+^ 



h + h + 



An 



(161) 



And again expanding the M"'s in powers of keeping a and of order 1, 
leads to W+ being quadratic in a and a\ with A^-independent coefficients. Using 
the Bogoliubov-like transformation described in Appendix A, it is thus a simple 
matter to find the largest eigenvalue of W+, which reads 



' 2p{2' - 1)N + 2'{1 - s) 



^4 



where h 



1 - 3p(l - p) 
hN + 0{l/N) 



%^p)2 ■ The critical value that emerges in (162) is given by 



if s < Sc 
(162) 



5c = log2Y + (-2 + log2 Ap + VAp - log2 Ap) + 0(1/Ar2) 

^ (163) 
When s > 0, the expansion of the W+ is valid only when s <ti \fN. When is 
(large and) fixed, the asymptotics of il)+{s) is 



i)+{s) ~ VhN 



hN^ + 2ApA^ - A 
N 



as 



oo 



(164) 



In Fig. (10) we have plotted ip^ (s) as a function of s. The most remarkable feature 
is the presence of dynamical transition at the critical parameter s = Sc- The 
nontrivial convex branch ceases to correspond to the largest eigenvalue of W+ at 
s < Sc, and it is simply replaced by a plateau. This picture, which is customary 
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Figure 10: Topological pressure liniTv^oo j^i^+is) on the special line (at p = 
0.57). The dashed line is the continuation of the strictly convex branch for s < Sc- 



in equilibrium phase transitions, reflects the existence of an underlying first order 
transition. As s is decreased from s = (corresponding to typical histories) one is 
selecting histories with less and less dynamical disorder. This indicates a phase- 
separation like mechanism occurring in the space of histories. We now attack the 
generic case for which the values of h and A are unrestricted. 

7.3 Generating function of the number of events for any A 

The task remains that of finding the largest eigenvalue i'xis) of W^- as given in 
(155). When directly expanded in N, the choice M° = L°' leads to the following 
expression for the evolution operator W^: 

- Wk{z) = ]v + (^/7«G + H^^a^^ Vn + H^^^ + 0{^/N) (165) 

where H^^\Hi^\H^]^ are c-numbers and H^^^ is quadratic in a and . While 
this seems a perfectly legitimate large expansion, the presence of nonzero Ha^^ 
or H^^ terms in (165) signals that the ground state of —Wk does not correspond 
to the zero boson state, but rather to an 0{N) boson state (on the special param- 
eter subspace A = A these coefficients of the linear terms in a and somehow 
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miraculously vanish). Indeed, in order to compute that spectrum we need to trans- 
late the creation and annihilation operators^ by a constant of magnitude \fN, but 
this mixes the whole expansion (165) of ^ k{z) in powers of A^. In particular, 
unless n'i^ = h'^^ = 0, the truncated expansion (165) is not sufficient to find 
the eigenvalues of Wk{z), even to lowest order in A^. Given that we wish to de- 
scribe — Wa''s low lying excitations, with a^a ~ we must now find a way 
to expand around the ground-state. By contrast to Ruijgrok and Tjon [45], we 
must now perform two successive rotations parametrized by a and m (around the 
y and the z axes) of the initial Holstein-Primakoff representation (156-158). The 
evolution operator Wxiz) then reads 



-Wk{z) = h + {N -n 



with My = Ly, 



Xn 



z 



ATI 



(166) 



P 
m 



— m 
P 



P 



and 



-1 < m < 1 
a > 
(167) 

The parameters of the two rotations, a and m, will now be chosen so that uji'^ = 
H^^ = in the truncated expansion (165) of (166). When these equations in 
a and m have more than one solution, we have to choose the solution which 
gives the highest value of ipK- Expanding Wxiz) in powers of and imposing 



Hi^^ = H^^ implies that a 
with 



' l+m 



and yields an expression of the form (165) 



H^^^ = (^4p^-^|(l + m)(l-p)-(3-2p-m)(l+m)j (168) 

Hi'^ = = (^(3m - l)^i(l + m)(l-p) + p(l - p - m)^ 

(169) 



From (169) we see that solving Ha^^ = H^\' = in m leads to either m = — 1 
or m is one of the roots of third degree polynomial. If m = — 1 is not the correct 
solution, this root must be inserted back into the expressions of H^"^^ and H^^^ to 
get iI)k{s). With a view to avoiding further technicalities, it is more convenient to 



^for instance, through similarity transformations such as e'^^a^e = + C. 



use algebraic elimination methods so as to find an equation on H^'^^ itself, and on 
the coefficients of H^'^\ Skipping details, one finds that when m 7^ —1, H^"^^ is 
one of the roots of the following polynomial 

P(X) = csX^ + C2X^ + ciX + Co (170) 
C3 = 16(l-p)2 

C2 = -27 (-1 + pf + 12 (-1 + pf (-4 + 3 p) - 8 (-6 + 12 p - 7p2 + p3) 
ci = -12 / (-1 + p)^ (-4 + 3 p) - (96 - 228 p + 184 p^ - 53 p^ + p^) 

+ (-2 + p)' (12- 12 p + p2) 
Co = (1-^2) [4z2(i_p)-(2-p)2]2 

We first consider the case s > 0. In that range of s, we see that by definition 
we must have tpxis) < 0. However, the solution m = — 1 of Ha^^ = h'^^ = 
yields V^i^(s) = 0, which is the highest possible value of tpxis). We thus have 
tpK{s) = in the whole s > range. We now assume s < 0. And again by 
definition we must have i'xis) > 0. The solution m = — 1 still yields iPk{s) = 0. 
We thus have to check whether P{X) has any negative solution. The discriminant 
of P(X) has the simple form 

^ = - 228 33 (\_p)5 (2 + ^' (-1+P)-P)' 

|3 [24^2(1 _ p) + p2 + i2p _ 12]' + (6 - pf (-2 + 3p)}^ 

(171) 

As A < in the range s < 0, P{X) has three real valued roots. Moreover, 
from the coefficients of (170) it is easy to see that the roots of P{X) have a pos- 
itive sum and a negative product, which shows that P{X) has only one negative 
root, namely, H^'^\ From Cardano's formula, setting q = (9C1C2C3 — 27coC3 — 
2C2) / (54C3) we find^ that in the range s < 

= + e2-/3 (^q + ^ + ^^2^./3 _ ^ (172) 

As a remark, we notice that the two rotations of parameters a and m could 
also be understood as the result of suitable similarity transformations of the kind 



^The expression of tpK takes real values but can't be written with algebraic operations involv- 
ing only real quantities: this is the casus irreductibilis of Cardano's formula. 
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performed on ^ k{z) before expanding in A^. In other words, 
finding the roots of (170) enabled us to perform an appropriate resummation of 
(165) to all orders in order to obtain a series whose truncation to lowest order has 
well defined spectrum, which makes the large expansion consistent. 

In order to be more explicit, we now provide the limiting behavior of ^/'x('S) = 



Nil>^^\s) + + C>{N ^) in two limits of interest, namely for s —>■ 0' 



',(0) 



2p(e- 



1^ 



{2p-3f 



(-4 + P (4 + p)) 



P 

(432 + p (-1248 + p (1188 + p (-444 + 79 p)))) 
12^ 



and for s 



-oo. 



lim e>g^(s) 

s— oo 

The remaining 0{1) piece in is given by 



(0), 
K ^ 



C + VD 



(173) 



(174) 



where C is a root from the polynomial 



P = z^ (-2 + pY + 4:z^ {-1 + p) -2X^ 

-Xz^ (-1 + p) P + 4X2 (-1 + p) (3^2 (-l+p) + 2p) 

and D is a root from the polynomial 

P = 256 X^{-1 + pf + 16 (-1 + pf (-27 {-I + pf + 24 z^ 



(175) 



-l + p)p-4p2) 



- ((-2 + p)' + 4 z^ (-1 + p)) (108 (-1 + p)' + 8 p=^ - 9 (-1 + p) (-12 + p (12 + p))) + 

SXz\-l + pf {-lQSz\-l+ pf -Sp^ + ^z^ (-1 + p) (-12 + P (12 + p))) 

(176) 

It is now time to summarize our findings, which we do in the following two plots 
Figs. (11) and (12), showing respectively the full plot of ipxis) as a function of 
s and that of the density p(s) = (1 + m(s))/2 corresponding to the rotation 
parameter m(s) as a function of s. 

On Fig. (11) we notice that "ipxis) is not analytic at some critical point Sc 
which corresponds to the phase-separation like mechanism depicted by the topo- 
logical pressure i/j+is) (see Fig. 10), but now at the level of the number of events 
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Pis) 




Figure 12: Plot of p{s) = ^^^'^'^^ in the N oo limit as a function of s at A = 2 
and h = 0.3. Note the presence of a jump at s = Sc ^ 0.16. 
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K. This result illustrates that this simple quantity - at least for infinite-range sys- 
tems - already contains much of the information given by on the complexity 
of histories. 

This is fully confirmed by Fig. (12). In analogy to the Ising case (119), p{s) = 
represents the mean density in the biased state Pxin, s): 



As usual, at s = we recover the density in the steady state. At s < we probe 
the regime in which the mean "activity" K/t of histories is typically larger than 
in the steady state. They correspond to explored configurations where the density 
is larger than the steady state density p. On the other hand, at s > histories 
with smaller K/t are favored. Increasing s leads to a sudden jump in the typical 
density, which corresponds to a dramatic change in the kind of configurations 
explored by histories with reduced activity K/t. 

7.4 Topological pressure: h = 

We begin by attacking the h = case for which the phase diagram possesses 
two stationary states, the active and the absorbing one. The topological pressure 
ip+is) is the largest eigenvalue of the operator W+(s) written out in (161). By 
techniques similar to those mentioned above, we arrive at 




(177) 



n 



(178) 




(1 + m)(l - p) 



2q' 



) 



(179) 




(180) 



\ 4(l-p)V 1-p + 4 1-p 




(Ao + sAi + S2A2) (181) 
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where we used the notations 



p = Vl - m2 (182) 

r = 3-m-2p (183) 

q = — ^^7^ r (184) 

2(1 — m)(l — p) 

Ao = ^ + (185) 

2 1 — m 

Ai = ^(p2_2r(l + m-p)) (186) 



;i +m)(l + m - 2p)^ 
2(1 — m)r^ 



A2 = J' (187) 



The rotation parameter m is the solution of 

2pr(l — m — p) = a/2(1 — p)(l + m)g* (s(l + m)(l + m — 2p) + (1 — 3m)r) 

(188) 

such that tp^^\s) has the largest value. The first cumulants can be determined 
without toil, 



— (Q,) = 2pln2- — 



P 8i^ln2 



1-p 



+ C(l/A^2) (139) 



-^^{QDc = P(ln2)2 + il-M(in2)2 + 0{1/N) (190) 

(191) 

Fig. (13) shows the topological pressure tjj{s) and the corresponding density p(s) 
is represented on Fig. (14). 

7.5 Topological pressure (11): h > 

Finally we turn to h > for which the explicit formulas read 

ij{s) = N'^'-^\s) + ^(°)(s) (192) 
^W(s) = 1 (-f + 2py/F^) (193) 
[l-s)u fq' 



= 2p'^ \l^ " (^0 + + ^'^2) (194) 
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Figure 13: Plot of the topological pressure limjv-^oo jfi^+i^) as a function of s at 
A = 5 and h — 0. Note the presence of a jump in the first derivative at Sc — 0. 



Pis) 
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-0.2 0.2 0.4 0.6 

Figure 14: Plot of p(s) = as a function of s at A = 5 and h — Oin the large 

system limit N ^ oo. Note the presence of a jump at Sc = 0. 
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where we used the notations 



p = \J\ — m'^ 

r = 2(2/i + A(l + m)) 

r = i(l — m)r + 2(1 + m) 



Ao = ^ + - + -- 



4r 



2 1-m 



Ai = Ah{l + mf X (-4 + (1 - m)^ X)+Ah^ (-8 + (1 



A, 



+ (1 + my A (-4 - 2 (1 + m) A + (1 - my A^) 
(f - 4(1 + m)Yu'^ 



(195) 
(196) 
(197) 

(198) 

(199) 

(200) 

my (1 + m) a) 
(201) 

(202) 
(203) 



and m is the solution of 

pf{h + Am — l)y/r = su (r — 4(1 + m)) + r (4/im — A(l + m)(l — 3m)) 

(204) 

such that ip^^ys) has the highest value. 



The values of the first two cumulants read 

1 8Ap(l-p)2 



J-(n ) = 2pln2 + — 



X 



P (l-A(l-p))' 



ln2 



(205) 



— (g^^)e = p(ln2)2 + p 



1 -2p + A(l -p)- 
l-A(l-p)2 



2\ 2 



(In2)2 + C»(l/Ar) (206) 
(207) 



The contact process also raises interest [47] in related computationally motivated 
problems where similar absorbing-state phase transitions have been identified. We 
believe that not only the KS entropy, but also the pieces of information contained 
in P+ or Pk, could shed a new light, with quantitative tools, on dynamical com- 
plexity issues. 
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8 Outlook 



Before concluding, we would like to discuss [52] on a simple example, namely 
Brownian motion, the difference between the Markov approach we were dealing 
with in this paper, and another possible approach which also generated a lot of 
literature in the field of dynamical and chaotic properties of systems. 

Let us first adopt the Lorentz gas picture [19] in which a particle is scattered by 
randomly placed obstacles. Over large distances, the particle is seen to perform a 
diffusive motion. Furthermore, two infinitesimally close-by particles will quickly 
follow exponentially diverging routes. This is a chaotic system. A Lorentz gas 
is well approximated by a Markov process. The possibility of choosing a variety 
of infinitesimally close initial conditions, leading to very different trajectories, is 
replaced with the drawing of random numbers whose net effect is to account for 
the chaotic nature of the Lorentz gas. Within this approach, such local characteri- 
zation of chaos like individual Lyapunov exponents cannot be accessed. 

An opposite approach to Brownian motion is the modeling in terms of a Langevin 
equation, say for the particle velocity, which evolves under the effect of an exter- 
nal position independent - yet random - force. Within this picture [53, 54, 55], 
the random force is viewed as an external field. Two close-by initial conditions 
will be subjected to the same realization of the random force. Within this picture, 
a simple Brownian motion is not a chaotic system. What can possibly make it 
chaotic lies in space-dependent forces due to interactions or to an external field. 

The difference in the two pictures lies in the observation scale compared with 
the intrinsic correlation length of the surrounding medium. In the first approach, 
the noise source is very short range correlated in space, but with long range time 
correlations. In the second approach, this is the exact opposite situation. When 
computing a Lyapunov exponent, before deciding which picture applies, one must 
compare the typical physical scales of the medium giving birth to a chaotic behav- 
ior. For times short with respect to the correlation time scale and distances large 
with respect to the correlation length, the first approach - the Markov one - ap- 
plies. 

If this is the case, we have shown that the thermodynamic formalism can suc- 
cessfully be applied to Markov dynamics with continuous time, provided that the 
proper interpretation is used for the definition of the dynamical partition function. 
In particular, a finite KS-entropy can be defined. This opens the door to explicit 
expressions for realistic systems. 

Besides, we have embedded this formalism into a more general picture. In- 
deed, the dynamical partition function can be expressed as the generating func- 
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tion of an observable. By noticing that other observables could be used as well, 
we are able to relate the quantities used in the thermodynamic formalism with 
those involved in the much studied Lebowitz-Spohn [8] fluctuation theorem. We 
also show on specific examples that the simplest observable one could think of, 
namely the number K of transitions occurring in a given time, is not as trivial as 
one could think and contains already some relevant information on the system. 
For example, for the infinite range Ising model, the cumulant generating function 
of K already indicates that a dynamical phase transition occurs in the low tem- 
perature phase. This is confirmed by the calculation of the more sophisticated 
topological pressure. 

We found also that one can gain some insight into these dynamical phase 
transitions by looking at a new object: the aforementioned cumulant generating 
function was obtained as the largest eigenvalue of a certain operator. If one also 
computes the associated eigenvector, one can build a quantity that weights the tra- 
jectories depending on the value the observable takes along them. In the example 
of the infinite range Ising model, this allows to show that the dynamical phase 
transition which occurs below the critical temperature gives rise to a splitting of 
the trajectories into two families, respectively typical of a disordered and of an 
ordered phase. 

The general unifying picture behind all this is that of a Gibbs ensemble con- 
struction carried out over the space of dynamical trajectories, rather than over 
microscopic states. 

We have illustrated our approach on several physical examples (an interacting 
lattice gas, a system exhibiting an equilibrium second order phase transition and 
one with a nonequilibrium phase transition). Our setup has allowed us to pro- 
vide an intrinsically dynamical picture to phenomena that are always interpreted 
in static terms. This constitutes a powerful tool that longs to be applied to systems 
for which no static phenomena has ever been identified, like those possessing 
glassy dynamics. It is tempting to speculate that ageing and other dynamical fea- 
tures of glasses will be identified with a sharp signature on some appropriately 
chosen dynamical potentials like those considered throughout this work. Some of 
these ideas can already be found in [56, 57]. But before addressing these challeng- 
ing issues, many questions remain to be answered for more conventional systems. 
As far as lattice gases are concerned, the general dependence of the KS entropy 
on the diffusion constant and the compressibility is one such question. Driving a 
lattice gas into a nonequilibrium steady-state (with a bulk or boundary field) leads 
to distinct dynamical features. How do these reflect on the dynamical partition 
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function? In the vicinity of a second-order transition, the dynamics possesses uni- 
versal features, so that the dynamical potentials i/jAis) introduced in this paper 
will obey universal scaling laws. Which are these? May be some universal scal- 
ing functions as the one found in [12] could emerge. The influence of quenched 
disorder, generically known to slow the dynamics down is one more open research 
route. 

Acknowledgments: The authors wish to thank T. Delattre for his participation in 
the early stage of this work, along with J. Tailleur, J. Kurchan and H. van Beijeren 
for their many helpful critical comments. 

A Non-hermitian quadratic operators and Bogoliubov- 
like transformation 

Holstein-Primakoff expansions of our evolution operators Wa for infinite -range 
models often lead to a "Hamiltonian" H that is quadratic in creation and annihi- 
lation operators a and 



We are interested in the lowest energy level of H. In order that the latter exists we 
shaU have to assume that = Z"^ - XY > and F < 0. 
Performing the similarity transformation Pf ^(. ■ ■)Pi with 



H = Xa^ + 2Za^a + Y{a^)^ 



(208) 



Pi=e 



(209) 



does not alter a while it shifts according to 




Z-A 



a' — 



Y 



a 



(210) 



Its purpose is to remove the term in H: 



Hi = P{^HPi = Y{a^f + 2Aa^a + A-Z 



(211) 



We now introduce the operator 



P2 = e 



(212) 
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It commutes with and shifts a according to 

p-^aPs = a- (213) 

Acting on Hi, it yields 

H2 = P2^HP2 = 2Aa^a + A-Z (214) 

As the similarity transformations (210) and (213) do not modify the spectrum 
of H{s), we see that the lowest energy level of H{s) is A — Z. When H is 
Hermitian {X = Y), the Bogoliubov transformation leads to exactly the same 
result. However, when H is not Hermitian, the Bogoliubov transformation can- 
not be implemented: contrary to (210) and (213), it does not transform a and 
independently, which was required here to obtain (214). 
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